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Abstract 

Collective migration of animals in a cohesive group is rendered possible by a strategic distribution of 
tasks among members: some track the travel route, which is time and energy-consuming, while the others 
follow the group by interacting among themselves. In this paper, we study a social dynamics system 
modeling collective migration. We consider a group of agents able to align their velocities to a global 
target velocity, or to follow the group via interaction with the other agents. The balance between these 
two attractive forces is our control for each agent, as we aim to drive the group to consensus at the 
target velocity. We show that the optimal control strategies in the case of final and integral costs consist 
of controlling the agents whose velocities are the furthest from the target one: these agents sense only 
the target velocity and become leaders, while the uncontrolled ones sense only the group, and become 
followers. Moreover, in the case of final cost, we prove an "Inactivation" principle: there exist initial 
conditions such that the optimal control strategy consists of letting the system evolve freely for an initial 
period of time, before acting with full control on the agent furthest from the target velocity. 


Introduction 

A fascinating feature of large groups is their self-organization ability, i.e. the emergence from local interaction 
rules of certain global patterns. For instance, animal groups such as schools of fish, flocks of birds or herds 
of mammals exhibit strong coordination in their movements, see e.g. laisiigiiniiiiiiiniiiniEiiEaiMiiini. 
This collective behavior in animal groups also inspired applications to robotics (see [4]), in which the aim 
is to coordinate autonomous vehicles la m [m EE] and flight formations ElETl. Other interests concern 
models in microbiology HU El El 1311311, pedestrian and crowd motions [HITE] and financial markets 
HIIIIES]- Such systems are usually referred to as social dynamics. Examples of self-organization include 
clustering of the agents, alignment of velocities, or other kinds of equilibria, see H El US m 1311311132 • 
This raises the question of understanding the mechanisms behind the global pattern formation. 

A well-known model was proposed by F. Cucker and S. Smale (see |14| 1 to describe the phenomenon of 
consensus in terms of alignment of velocities in a group on the move. The Cucker-Smale model in formula 
is written as: 

{ Xi = Vi 

. ^ 1 A, Vj-v^ for f G {1, ...,1V}, (1) 

a+ \\x,-x.\\^)p 

where /3 > 0, and Xi G and Vi G are respectively the state and velocity. This model was originally 
designed to describe the formation and evolution of language, and the variables Vi can more generally 
represent opinions, preferences or invested capital. The system converges to consensus if f3 < which 
corresponds to a strong interaction even between distant agents, see H E]- On the other hand, if /3 > 
i, i.e. if the interaction is too weak, convergence to consensus only happens under certain conditions. 
More generally, the term (1 -|- \\xj — Xi\\‘^)~^ can be replaced by a{\\xj — a;i||). Intuitively, it is natural to 
define a as a non-increasing function, since proximity often encourages interaction. On the other hand, it 
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was proven that interactions modeled by non-decreasing functions a, called heterophilious, in fact enhance 
consensus (see |1S]). When the system does not converge to a desired state, a natural question is to study 
the possibility of steering it via controls functions Ui, in which case the second equation of Q becomes: 

= -k (see [ZHHHZl). 

In the collective migration problem (see |2h|). not only do agents interact with one another to travel as 
a group, but they also gather clues from the environment guiding them towards a global target veloeity. In 
the case of migrating birds, for instance, this velocity can be sensed through a magnetic field, the direction 
of the sun, or environmental features. However, sensing the migration velocity is costly, both in used time 
and energy. A trade-off thus occurs between gathering this information, which ensures more precision, and 
following the group, which is less costly and saves time and energy for other tasks such as surveying for 
predators [mug. This problem also applies to the field of robotics, in which gathering information from 
the environment is done at the expense of communicating with other robots (or planes, drones, etc.) or 
performing other tasks, and to the field of economics when one aims to influence decisions of a group based 
on limited information. This trade-off naturally separates the group into leaders, who gather information, 
and followers, who only interact with the other agents (see |19p. 

We study a Collective Migration Model, where the agents’ dynamics is determined by two forces: the 
attraction towards a target velocity V (which we assume can be sensed) and the consensus dynamics as in 
the Cucker-Smale model. More precisely, each agent’s evolution is governed by a parameter ai G [0,1] which 
provides the balance between the two forces. The system can be written as: 


{ Xi = Uj 

Vi = a,{V 


1 N 

Vi) + (1 - a,)— ^ a{\\xj - x,\\){vj 


v^) 


for i G {1,..., N}, 


( 2 ) 


where Xi G and Vi G are the state and velocity, H G is the target velocity, and G [0,1] is the 
control, with the constraint J^i ^ ^i M > 0. In this paper, we choose to set a = 1, so that the strength 
of interaction does not depend on the agents’ positions. This is a reasonable hypothesis for instance if we 
consider groups of planes or drones that can communicate just as easily from great distances. 

While the Cucker-Smale model leads to alignment of all velocities to the average one (when there is 
consensus), the migration model tends to align all velocities to the preassigned target velocity. Our work 
focuses on finding optimal control strategies in order to achieve consensus to the target velocity, and in 
particular on selecting optimal controlled leaders among the agents when the control strength M is small 
with respect to the size of the group. In order to do that, we define the cost function 'V = ^ 11^* ~ 

measuring the distance from consensus at the target velocity. We first show that, given any M > 0, the 
strategy to decrease V instantaneously, with the constraint J2i ^ consists of distributing the control 
among the agents with the largest positive projections of velocities along v — V (where v is the mean velocity). 
In particular, if {vi,v — H) < 0, the agent i is not controlled {ai = 0). 

We then study the optimal control strategy to minimize V at a fixed final time and first focus on the case 
of two agents, with control bounded by M G [0,2]. The optimal control strategies depend on M but, in all 
cases, we act with larger control on the agent with the largest projected velocity. Furthermore, if the final 
time is too short to bring the agents together, then there are initial conditions for which at first the system 
must evolve with no control (a = 0). We call this phenomenon "Inactivation", in line with the "Inactivation 
Principle" proven in m in the context of arm movements. In this collaborative work with biologists, the 
authors prove that during fast arm movements, it is optimal to simultaneously inactivate both agonistic and 
antagonistic muscles for a short moment nearing the peak velocity. We next generalize our results to any 
number of agents, but with the constraint M < 1. Then the optimal control strategy acts with full strength 
on a sub-group of agents to bring them together. Also in this case we observe "Inactivation", which occurs 
when the initial average velocity v is very close to the target velocity V. Indeed, driving the system to 
V requires both achieving consensus and moving the average velocity towards V. If the average velocity 
is already close to V, then we are left with inducing consensus which happens naturally without control. 
However, simulations show that Inactivation is rare and its performance gain is very minor compared to a 
full-control strategy. 

Then we move on to examine integral costs jQY{t)dt and show that the optimal control strategy never 
exhibits Inactivation. More precisely, we must use full control at all time splitting it evenly among the agents 
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with the biggest projected velocity. Such a strategy is more restrictive than that with final cost, since the 
controls are completely determined by initial conditions, while previously we could use any strategy bringing 
agents together at final time. 

The paper is organized as follows. In Section we define the cost functional and make general obser¬ 
vations. In Sectionwe determine the strategy to decrease it instantaneously in time. Then, in Section]^ 
we introduce the optimal control problem to minimize the cost function at a given final time. We solve it 
for the particular case of two agents (Section before generalizing to any number of agents with a control 
bounded by 1 (Section]^. Lastly we find optimal control strategies to minimize the integral cost (Section 

§. 


1 Cost function and general observations 

With no loss of generality, we set the target velocity V to zero. Having simplified the interaction function 
a, system © reduces to: 


V, = -a,v, + (1 - L - ^i) 


(3) 




We set a final time T > 0. Then given M > 0, we define the set of controls Um as: 

N 

Um = |q! : [0,T] —>• [0,1]^ a measurable, s.t. for all t, < m|. 

i=l 


(4) 


1.1 Projection of the Dynamics 

Note that the dynamics ^ can be written in the more compact way: 

ix, = v, 

= -Vi -I- (1 - ai) V, 

where v represents the mean velocity v = ^ The evolution of v is given by u = so the 

direction of v is an invariant of the dynamics. We begin by assuming that the initial average velocity is 
different from the target one: 

Hypothesis 1. u(0) yf 0. 

This first assumption is only made in order to render the problem interesting. Indeed, if w(0) = 0, i.e. 
if the mean velocity is already at the target velocity V, then according to the evolution v = h 

would hold v{t) = 0 for alH > 0. Then looking at Equation (|^, we notice that the system is not controllable 
and that each velocity decreases exponentially to zero. We can then define the invariant unit vector e = ||L||. 
Let Wi = Vi — {vi,e) e be the projection of Vi over (u"*'). Then 

Wi = -Vi -I- (1 - Qfj) u - {-Vi -f (1 - Ui) v,e) e = -Wi. 

Therefore the projection of Vi over (u'*') decreases exponentially, independently of the controls ai. Let us now 
define^* = {vi,e). Its evolution is given by: ii = -{vi, e) + {1- ai){v, e) = -^i-|-(l-Q:i)||u|| = -^i + (l-ai)C- 
In the following, we will only study the equations governing the evolution of the projected variables ^i'. 

For alH G {!,...,iV}, (1 - (6) 

where ^ ^ ^j- This is a significant result: instead of studying a system evolving in we consider 

a system in , thus greatly reducing the complexity of theoretical and numerical analyses. Hereafter we 
shall make the following hypothesis: 
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Hypothesis 2. ^*(0) > 6+i(0) for every i e {1, ...,N - 1}. 

This assumption allows us to order the initial projected velocities without loss of generality. 


Proposition 1.1. 

Having made Hyp. and Hyp. it holds v{t) ^ 0 and ^{t) > 0 for all t G [0, T]. 

Furthermore, let t G [0,T]. If > 0, then ^i(t) > 0 for all t G If f,i{T) > 0, then f,i{t) > 0 for all 

t G [t,T]. 

Proof. The proposition is mainly a consequence of Gronwall’s inequality: It holds 




1 

N 



V 



) 


{v, 



(7) 


and 




Hence, if u(0) ^ 0 and therefore ^(0) > 0, then ^(t) > e > 0 and thus v{t) 0 for all t G [0,T]. 

Now notice that from (§ we can compute for all t G [t,T]: ^i(t) = e + f^(l — ai)(s)^(s)e^ ^ds), 

so ^i(t) > which proves the second part of the proposition. □ 


1.2 Migration functional 

We introduce the functional 

1 ^ 

^ = (8) 
i=l 

which measures the distance from consensus at the desired velocity V. Since we set P = 0, V reduces 
to: V = the new projected coordinates the migration functional can be written as: 

V = + fi)} where only the second term can be controlled. Hence, here onward we will only 

consider the controllable part of V, which we denote V: 

( 0 ) 

i=l 

Notice that V can be written as a sum of two terms: 

1 ^ 

^ = + M ( 10 ) 


which should be minimiz ed si multaneously (where we remind that f ^ ?*)■ Minimizing (or since 

according to Proposition ^ > 0) corresponds to steering the system as a whole to the desired velocity 
y = 0. On the other hand, minimizing ~ corresponds to driving the system to consensus. 

However, the dynamics ([^ of show that if < 0, decreasing ^ slows down the increase of ^i, resulting in a 
possible increase of (^i — Hence, minimizing V requires balancing the decrease of the two terms in (lOl. 


1.3 Minimization problems 

In the following sections, we will deal with the minimization of different quantities, in order to design a 
strategy for consensus at the migration velocity V = 0. Having fixed the final time T a priori, we address 
three problems: 

(z) The minimization of i.e. the maximization of the instantaneous decrease of V (see Section [^. 

{ii) The minimization of the final cost Y{T) (see Sections and [^ . 
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(in) The minimization of the integral cost (see Section |^. 

In order to minimize (ii) Y(T) and (in) Y(t)dt, we will design an optimal control strategy using 
Pontryagin’s maximum principle. The minimization of V, on the other hand, will not provide an optimal 
control. 


2 Instantaneous Decrease 


In this section we look for a control strategy maximizing the instantaneous decrease of V. Strategies designed 
in this way are not optimal (in general), but are easier to study and can give a first good insight on the 
problem. Indeed, we will later compare the instantaneous decrease strategy to the optimal control strategies 
developed in Sections and 

The time derivative of the migration functional V is given by: 


N / N N \ N 

= 4 E = 4 E + E(1 - = -2V + |cE(l - 


2=1 




2 = 1 


2 = 1 


Since ^ > 0, minimizing V amounts to the following problem: 

N 

Find min E(i “ 

i=l 

which can be done as follows (where [M\ and \M~\ respectively denote the floor and the ceiling of M, and 
I • I denotes the cardinality of a set): 

Proposition 2.1. Suppose that ^i{t) > ... > ^jv(t) (or re-arrange the agents so that this is satisfied). Then 
the following strategy minimizes at time t: 

Define I+{t) = {i G {l,..,fV}, ^,{t) > 0}. 

If |/"'"(t)| < M, then set ai(f) = 1 if i G I~^ and aift) = 0 otherwise. 

If |/+(t)| > M and Ctm-i] > = !*/*< L-^J; aLA^J+i(^) = M - \_M\ and 

ailt) = 0 otherwise. 

V M and = CiM] or = CiM+i], let /|-m] = {i G {!,...,iV}, ^i{t) = ^|■M](^)} and 

■^[M] = r^l} \ • Then set ai(t) = 1 if i £ 7*^^, a^{t) = if i G 7|-m] and ai{t) = 0 

otherwise. 


3 Optimal control for final cost 


In this section, we focus on problem {ii) (see Section 1.31, i.e. minimizing the migration functional V at final 
time T using Pontryagin’s maximum principle. 

Let us compute the Hamiltonian H of the scalar system ® : 


N 


N 


N 


^ = E = -e'E + E +C) 


( 11 ) 


2 = 1 


2=1 


2=1 


By Pontryagin’s maximum principle |35| . if a € Um, associated with the trajectory is optimal on [0,T], 
then there exists A : [0,T] —)■ such that ^ ^ and A = Furthermore the following minimization 

condition holds for almost alH € [O,^]: 


H{t,^{t),X{t),a{t)) 


min 


H{t,at),x{t),m)- 


( 12 ) 
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Since ^ > 0, minimizing H requires to set Ui = 1 on the biggest positive A^. The differential equation for 
the covectors Xi gives: 


N 


3H 1 _^ - 

Aj = “ jY X! * S {1, N}. 


(13) 


i=i 


From this we can also compute the evolution of A = ^ A^: 


N 




1=1 


Since the final condition for ^ is not fixed, the final condition for A at time T gives: 

A(T) = VV(C(r)) = (^UT),^iN{T)] . 


(14) 


(15) 


Proposition 3.1. If t > 0, i,j e {1, , and Xi{t) = Xj(t), then Xi{t) = Xj{t) for all t. In this case, for 

a given control a, any control a satisfying di + dj = ai + aj and dk = ctk for every k ^ i,j gives the same 
evolution of X. If the control a satisfies the Pontryagin Maximum Principle, then the control d also does. 

Proof. Assume that at time i, Xi{t) = Xj{t). Let us define Zij = Xi — Xj. The evolution of Zij is given by: 
Zij = Xi — Xj = Xi — Xj = Zij. Hence, Zijft) = Zij{t)e^~*, and if Zij{t) = 0, then for all t, Zijlt) = 0, i.e. 
Xiff) = Xjff). From this it follows that if a minimizes the Hamiltonian H, then any control d satisfying 
di + dj = ai + aj and dk = Ofc also minimizes H, since one easily sees from (11 \ that = iJ“ (where we 
denote by the Hamiltonian obtained with the control function a). □ 

Still assuming that the projected velocities are initially ordered (Hypothesis]^, the following lemma will 
allow us to further assume that they are ordered at all time. 

Lemma 3.2. 

There exists an optimal strategy satisfying the following: For all t S [0,T], 

Ifi<j,thenii{t)>e,j{t). (16) 

Proof. Consider an optimal control strategy a S Um- _ 

Define r = sup{t € [0,T]; 3/3 S Um s.t. ^p{T) = Vq(T) and satisfies (161 on [0,t]}, where Yjs and 


denote respectively the migration functional and the dynamics driven by the control j3. Let us prove by 
contradiction that t = T. Suppose that t < T. Then there exist i,j G {1,...,7V} with i < j such that 
^f(r) = fjir) and fj{t) > {t) on ]t, r + i5] for some 5 > 0. Design a control strategy /3 such that on 

[t,T], Pi = Pj, Pj = P, and for every k G {1, ...,N} \ {i,j}, Pk = Pk- Then for all t G [r,T], ^f(t) = ^|(t), 
and (t) = (t). So for all t G [r, r + 5], {t) > {t) and V^(T) = V^(T). Proceeding likewise for every 

pair of indices (m, n) satisfying m < n and ^^{t) < f^{t) on ]r, r+ 5] we are able to design a control strategy 
P satisfying ( |l6| on [0,r + 5] and V^(r) = Y°(T), which contradicts the definition of t. In conclusion, 
T = T, i.e. for all t G [0,r], for every i,j G {1, if i < j then ^i{t) > ij{t). □ 

Hence, from here onward we shall assume that the variables f^i are ordered at all time. 

Hypothesis 3. If i < j, then fi(t) > f,j{t) for all t G [0,T]. 


From Hyp|^and the transversality condition (151, we know that the covectors are ordered at final time, i.e. 
Ai(T) > ... > Xn{T). From Prop. |3.1[ we can generalize this for any time t: 

Ai(t) > ... > Ajv(t) for alH G [0,T]. (17) 


The Pontryagin Maximum Principle allows us to state the following: 


6 





Proposition 3.3. The optimal strategy requires controlling the agents with the biggest positive covectors. 
Let a € Um be an optimal strategy and Xi, i G {1, the corresponding covectors. Define: 


hit) := {i e iV} I A,(t)>o} 


and 


It 


it) := {z e iV} I A,(t) >0}. 


(18) 


If the set Ixit) is empty, then there is no control on any agent: aiit) — 0 for every i. 

If the set I^ it) not empty, then there exists i G I^it) such that aiit) > 0. Furthermore, > 


Proof. Accordin g to Pontryagin’s maximum principle (121, if the control a is optimal, then it minimizes the 
Hamiltonian H (11) for almost alH G [0, T]. The only controllable part of H is H = —f^^onXi. Minimizing 
H requires controlling the largest positive Xi with the maximum strength allowed, while setting = 0 if 
Ai < 0. If Ai = 0, Pontryagin’s maximum principle gives no information on Oi. □ 


This leads to a trichotomy of cases. 

• The biggest positive A^’s are always controlled with maximum control: J2iei+ — mi^id^A'I)-^)- 

• If for i,j, Xi and Xj coincide (at a certain time, which implies at all time) then ai and aj are under¬ 
determined. The PMP only requests that ai + aj = c where c is given by the strength of the control 
to be used on the two agents. 

• The negative A^’s are never controlled: if Xi < 0, then ai = 0. 


Remark 3.4. The existence of an optimal control for the problem described above is ensured by the convexity 
of the sets P(t,0 = {(^i + (1 - «i)l)i=i.„Ar) « G [0,1]^, E* (see 


4 Final cost with two agents 

For a clearer understanding of the mechanisms taking place, we consider the simple case of two agents in 
W^. We consider the sets of controls Um, where 0 < M < 2. Thus, system (|^ becomes: 


('ei = -ei + (l-ai)e 

1^2 = -^2 + (1 - 0:2) f. 

Computing the difference of the two projected variables will also prove useful: 


(19) 


Cl - ^2 = -(Cl - C2) - (ai - a 2 )C- 


( 20 ) 


Three different situations may arise, depending on the value of the constraint on the control. Indeed, two 
constraints are set: ai + 02 < M, and 0 < < 1 for i = 1, 2. We differentiate the cases (a) 0 < M < 1, (b) 

1 < M < 2 and (c) M = 2. 


4.1 Pontryagin’s Maximum Principal 

Notice that the migration functional can be written as: 

v=i(C? + Cl) = J((Ci + C2)^ + (Ci-C2)^)=C'"+(^^) , (21) 

once again emphasizing the necessary trade-off between two terms: the mean velocity C and the distance 
between the agents |Ci — C 2 |- Computing the Hamiltonian of the system gives: 

Hit, C, A, a) = -C (oiAi + a 2 A 2 ) + - A 2 ). (22) 

In line with Hyp. two cases are possible: Ci(0) = C2(0) or Ci(0) > C2(0). The following proposition 
deals with the first case. 
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Proposition 4.1. If ^i(0) = ^ 2 ( 0 ), then a control strategy a is optimal if and only if it satisfies 01+02 = M 
and ei(T) = 6(T). 

Proof. Consider the control given by 01 = 02 = It achieves ~ f. 2 {T))]^ = 0 and ensures the 

maximal decrease of thus is optimal for the minimization of V(T) ( [2T| . Still from pTj ), a control o is 
optimal if and only if it achieves [^(Ci(^) ~ ^ 2 ( 2 ^))]^ = 0) which is equivalent to £,i{T) = f, 2 {T), and ensures 
the maximal decrease of which is equivalent to 01+02 = M. □ 

Hence, the case 5i(0) = ^ 2 ( 0 ) is fully understood. In the following, we will deal with more complex cases 
by assuming: 

Hypothesis 4. ^i(O) > ^ 2 ( 0 ). 

Before studying each case in detail, we give general considerations on the relation between the control o 
and A: 

(a) If M < 1, minimizing H (i.e. maximizing (A, o)) gives (see Fig{^: ( 01 , 02 ) = (M,0) if 0 < A 2 < Ai; 
( 01 , 02 ) = {MI2, M/2) if 0 < A 2 = Ai; ( 01 , 02 ) = (M, 0) if A 2 < 0 < Ai; ( 01 , 02 ) = (0,0) if A 2 < 0 and 

Ai < 0. 

(b) If 1 < M < 2, minimizing H gives (see Fig[^: ( 01 , 02 ) = (1,M - 1) if 0 < A 2 < Ai; ( 01 , 02 ) = 
(M/2, M/2) if 0 < A 2 = Ai; ( 01 , 02 ) = (1,0) if A 2 < 0 < Ai; ( 01 , 02 ) = (0,0) if A 2 < 0 and Ai < 0. 

(c) If M > 2, minimizing H gives (see Fig[^: ( 01 , 02 ) = (1,1) if 0 < A 2 < Ai; ( 01 , 02 ) = (1,0) if 
A 2 < 0 < Ai; ( 01 , 02 ) = (0, 0) if A 2 < 0 and Ai < 0. 

Notice that in all three cases, if Ai = A 2 , then the Pontryagin maximum principle does not give sufficient 
information since any combination of oi and 02 such that oi +02 = M minimizes the scalar product —(A, o) 
(see Figure [^. 





Figure 1: Minimizing — (A, a) 


The dynamics for A are given by A = 
evolution of the difference Ai — A 2 : 


-VH = 


l+ai 


Ai - ^A 2 


1 + ^2 \ 

A2 - 


1-ai 

2 


Al 


— (Ai — A2) — Al — A2. 


which allows us to compute the 


(23) 


The transversality conditions give: A(T) = VV(T) = (^i(T),^ 2 (P))^- Hence, if the final configuration is 
such that £,i{T) ^ £, 2 {T), he. Ai(T) A 2 (T), the difference Ai — A 2 increases with time. On the other 
hand, if Ai(T) = X 2 {T), then Vt < T, Xi{t) = X 2 {t). If the dynamics allow us to drive ^1 and ^2 together 
before time T, then Ai(<) = X 2 {t) for all t, and the Pontryagin maximum principle does not give sufficient 
information, as seen above. 



















4.2 Global Strategy 

According to equation pT| , the functional V can be written as: 

V = ^ ~ . (24) 

Minimizing V requires minimizing ^ and (^i — ^ 2 )^ simultaneously. The evolution of ^ is given by: 

l=-^(ai+a2)e, (25) 

while that of (^1 — ^ 2 )^ is: 

^ ((Cl - 6)^) = -2(Ci - ^ 2 )^ - 2(Ci - C2)C(ai - a2)- (26) 

Thus, minimizing (both instantaneously and globally) requires using full control, i.e. setting 01 + 0:2 = M. 
On the other hand, the strategy to minimize (Ci — ^ 2 )^ is less clear. It would require both maximizing C and 
maximizing the difference oi — 02 (assuming that Ci ~C 2 ^ 0)j and these conditions might not be compatible. 


4.3 Case M = 1 


Theorem 4.2. 

Let T > 0 and let M = 1. Furthermore, let a = ( 01 , 02 ) G Idi (see be an optimal control and C be the 
corresponding trajectory of system (19l. Define to = 2 ln(Ci(0)/C(0)). Then 


(i) T > to if and only if fi{T) = f, 2 iT). In such a case, the control satisfies: oi + 02 = 1 (so f(t) = 
C(0)e“‘/^/ For instance, the strategy (oi,a 2 )(t) = (1,0) for all t G [0,to[ and (oi, 02 )(t) = (1/2,1/2) 
for all t G [to,T] is optimal. 

(a) If T < to, then a{t) = (0,0) for all t G [0,t*[ and a{f) = (1,0) for all t G [t*,T], where t* = 21n(A) 
and X G is defined as follows: 


X = arg min 

XG[l.e'r/2] 


(Ci(0) + C(0)(A2 _ i))% (^^(0) + ^-(o)(x2 - 1) + 2C(0)A(e^/2 _ 


Proof. Let C be an optimal trajectory achieved with optimal control a. 

To prove (i), we shall show that the three statements (a) T > to, (b) there exists t G [0,T] such that 
Ci(t) = ^ 2 {t) and (c) Ci(^) = ^ 2 iT) are equivalent. 

Suppose (6) there exists r G [0,T] such that ^ 1 ( 1 ") = C 2 ('i‘)- Then necessarily fi{T) = ( 2 iT). Indeed, suppose 
that Ci(^) 7 ^ ^2(1"). Then any strategy 0 such that on [0,r], 0 = 0 and on ]t, T], (01,02) = , 01+02 ^ 

achieves: ((T) = ^(T) and (fi — i 2 )^(T) — 0 < (fi — ^ 2 )(T) (where f, V denote the trajectory and cost 
corresponding to d), so according to equation (241, V(T) < V(T) and control strategy o cannot be optimal. 
Hence, ^i(r)=C 2 (T). 

Now suppose (c) fi(T) = ^ 2 ( 1 "). The transversality condition © gives Ai(T) = A 2 (T) and from Proposition 


3.1 we get: Ai(t) = A 2 (t) for all t G [0,T]. Then, A = ^o^Ai = (^Oi)A. Since ^(T) > 0, the transversality 
condition (15) gives: A(T) > 0, and A(t) = Ai(t) = X 2 (t) > 0 for all t G [0,T]. Therefore, the set Ix, see 
(18), is not empty, so according to Proposition 3.3 the optimal control strategy requires using maximal 
control strength: oi + 0:2 = 1- According to equation (25), this suffices to fully determine f{t) = ^(0) 

Then ^i(<) - ^ 2 ( 1 ) = e"‘ (^{(i - ^2)(0) - C(0) J^iai - Q:2)e®/2ds^, and ^i(t) - ^ 2 ( 1 ) = 0 if, and only if, 

/q e®/^(ai -Q; 2 )(s)ds = (Ci(0) -C2(0))/C(0)- Notice that min(Q,j ^ 2 )eWi{^ I (6 -C2)(0 = 0} is obtained when 
ai — 02 is maximal, i.e. for (q;i,q: 2 ) = (1,0)- With this strategy, rnin(c,j I ('Ci ~ (. 2 ){t) = 0} ■= = 

21n(^i(0)/f(0)). Hence, we must have: T > to. 

Lastly, suppose (o) T > to. Design a strategy a so that for all t < to, ( 01 , 0 : 2 ) = (1,0) and for all 
t > to, ( 01 , 02 ) = (1/2,1/2). This strategy is optimal since it maximizes the decrease of see (25), and 


achieves (^1 — (, 2 ){T) = 0, see (26). Hence, our optimal strategy o must also satisfy: ^i(T') = f, 2 (T) and 
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Q!i + 02 = 1. This proves (6). 

We showed that (a), (5) and (c) are equivalent. We thus proved the first part of the proposition: T > to if 
and only if ^i(r) = ^ 2 {T). In this case, it also holds: oi + 02 = 1. 

If on the other hand, (ii) T < Iq, then ^i(t) > ^ 2 {t) for all t G [0,T] (since (6) implies (a)). According to 
condition ( |T^ and to Prop. 3.1 Ai(t) > A 2 (t) for all t G [0,T] and Ai(T) > 0. The evolution of Ai is given 
by: Ai = ^(oiAi + q: 2 A 2 ) + Ai — A > 0 since Ai > A. Hence, two cases must be distinguished: either Ai > 0 
at all time, so the set J(j" is non-empty and full control will be used at all time, or there exists t* s]0, T[ such 
that Ai < 0 on Ai(t*) = 0 and Ai > 0 on ]t*,T], in which case a = (0,0) on [0,t*[ and a = (1,0) on 

]t*,T]. Knowing this, it is easy to express ^ 1 , ^2 and V as functions of t*: 


fei(f) = e-‘(ei(0)+e(0)(e‘*-l)) 

Vt G \ 6(f) = e-‘(6(0) + 60)(e‘* - 1) + 260 )e‘*/ 2 (e ‘/2 _ e‘*/ 2 )) . 

[v(t)=c?(f) + C|(f) 

Denoting X = e* Y(T) can be written as a biquadratic polynomial in X: 

Y{T){X) = e-2^ [(^i(0) +^“(0)(A2 -if + (^2(0) +60) (A^ - 1) + 260)A(e^/2 - A))^ 


(27) 


We look for A minimizing Y(T){X) in the interval [l,e^/^] (so that t* G [0,T]). Notice that the leading 
term is ■ X^. Hence, there are at most two local minima in the interval Furthermore, 

V(T)(1) _= e-2^ [6(0)2 + + 260)(e^/2 - 1))^] and Y{T){e^f = e-2^[(6_(0) + 60)(e^/2 - 1))^ + 

(6(0) +60)(c^ ~ so V(T)(1) < Y{T){e^/'^), which means that A < If A = 1, then = 0 so it is 
optimal to act with control (1, 0) on the full interval [0, T]. If 1 < A < then 0 < t* < T. The optimal 
control strategy will require leaving the system to evolve without control on [0,t*[, and acting with control 
a = (1, 0) on [t*, T]. □ 


Remark 4.3. The existence of an initial "Inactivation " period can be proven also with any number of agents 
(see Theorem 5.3). Numerical simulations with any number of agents (see Section 5.2) show that in some 
cases it is indeed optimal to let the system evolve without control on an initial time interval [0,t*], where 
t* > 0. 


4.4 Case M < 1 

Generalizing to the case of any M < 1, we conduct the same analysis and the optimal control strategy is 
similar. 


Theorem 4.4. Let T>0 and M<1. Let a = ( 01 , 02 ) G Um (see (0; be an optimal control and ( be the 
corresponding trajectory of system (19l. Define to = 2 -m (6(0) ~6(0))/60) + l)- Then 


(i) T IL to if and only o/6(T) = 6(’f^)- case, the control satisfies: oi + 02 = M (so f,(t) = 

6o)e-^^*/2;. 


(a) If T < to, then there exists t* G [0,T[ such that a{t) = (0,0) for all t G [0,t*[ and a{t) = (1,0) for all 
t G [t*,T]. 

Remark 4.5. To compute t* G [0,T[ in the case T < to, one can compute V(T)(e* depending on 
t* G [0,r] similarly to the case M =1. 


Proof. Let ( be an optimal trajectory achieved with optimal control o G Um- We argue as in the case M = 1. 
To prove (i), first suppose that there exists t G [0,T] such that 6(''') = 6('^)- Then, as in the case M = 1, 
necessarily it holds f,i{T) = 6(2^) any strategy achieving 6(T) = 6(T) while using maximum control 
Oi + 02 = M is optimal. Then 6(f) ~ 6(f) = 0 <+> e^6^®(oi — 02 )(s)ds = (6(0) ~ 6(0))/60)- Hence, 

mincgw„{t I (6 — 6)(f) = 0} is obtained when oi — 02 is maximal, i.e. for ( 01 , 02 ) = {M,0). With this 
strategy, minQg;^„{t | (6 — 6)(f) = 0} = 6 as defined above. Hence, if there exists t < T such that 
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^i(t) = ^ 2 ('r), then T > to. This proves the first implication of the proposition: if ^i(T) = ^ 2 {T), then 
T > to. 

Conversely, if T > to, then the strategy (q!i,q; 2 ) = (-^,0) on [0,to[ and (ai,a 2 ) = on [to,T] 

is optimal since it minimizes ^(T) and achieves ^i(T) = ^ 2 {T). Hence, if a is optimal, it must also satisfy 
Oi + 02 = M and ^i(r) = ^ 2 {T), which proves the second implication. 

Now assume (ii) T < to. From (i) we get: ^i(t) > ^ 2 {t) for all t € [0,T]. One can then argue as in the 
case M = 1. According to Pontryagin’s Maximum Principle, 02 = 0 and two cases have to be distinguished: 
either Ai > 0 at all time, so the set (see p^ ) is non-empty and full control will be used at all time, or 
there exists t* e]0,r[ such that Ai < 0 on Ai(t*) = 0 and Ai > 0 on ]t*,T], in which case a = (0,0) 

on [0,t*[ and a = (M,0) on ]t*,T]. 

□ 

Remark 4.6. Notice that in the limit case M —>■ 1 0 / Theorem \4-.4\ one finds the same expression for to as 
in Theorem \A.2\ 


4.5 Case M = 2 


In order to determin e th e optimal strategy, let us first study the evolution of the covectors A. From ^i{T) > 
^(T) > 0 (see Prop. and Hyp. and the transversality condition ([T^, we get Ai(T) > 0. 


Proposition 4.7. Let M = 2 and Ai and A 2 be the covectors corresponding to an optimal control strategy 


for the system (19l. Then they satisfy the following properties: 


(i) If X 2 {T) > 0, then Xi{t) > 0 and X 2 {t) > 0 for all t G [0,T]. 

(ii) If X 2 {T) = 0, then Xi{t) > 0 and X 2 {t) = 0 for all t G [0,T]. 

(Hi) If X 2 {T) < 0, then X 2 (t) < 0 for all t G [0,r]. 

Proof. 

(i) Let A 2 (T) > 0. Suppose that there exists r G [0,T[ such that A 2 (t) = 0 and X 2 {t) > 0 for all t g]t,T]. 

Then since Ai > A 2 > 0 onjr, T], according to Pontryagin’s maximum principle (see Section J;..!), ( 0 : 1 , 02 ) = 
(1, 1) on ]t, T], which gives the following evolutions: Ai = Ai and X 2 = X 2 . Hence, A 2 (r) = A 2 (T')e'^“^ > 0, 
which contradicts the definition of t. Therefore, X 2 (t) > 0 for all t G [0,r], and by Ai(t) >0 . 

(ii) Let X 2 {T) = 0. Let r := inf[o^T]{t G [0,T] s.t. X 2 {t) = 0 for all t > t} and suppose that r > 0. By 

definition of t, A 2 (t) = 0. Since Xi{t) > X 2 {t) for all t (see Prop. \3 .![ ), there exists an interval [r — S,t[ on 
which Ai > 0 and either X 2 > 0 or A 2 < 0. If X 2 {t) > 0 for all t G [t — 5,t[, then according to Pontryagin’s 
maximum principle (Section 4-lh the control satisfies oi(t) = 02 (t) = 1, which gives: X 2 (t) = X 2 (t) > 0. So 
^ 2 ( 1 ') > 0, which contradicts the definition of t. If on the other hand X 2 (t) < 0 for all t G [t — r[, then 

C( 2 {t) = 0 and X 2 {t) = ^X 2 {t) < 0, which is impossible since it implies A 2 (t) < 0. Hence, r = 0. Furthermore, 

since Ai(T) > 0 and X 2 = 0, then Ai = Ai in a neighborhood ofT, which ensures that Xi{t) > 0 for all 
t G [0,T] (by the same reasoning as in (i)). 

(Hi) Let X 2 {T) < 0. Define t := G [0,T] s.t. Xi(t) > 0 and X 2 {t) < 0 for all t > t}. Then on]T,T], 

as seen in Section oi = 1 and 02 = 0, which gives: X 2 {t) = A 2 (T)e^“'^. Since X 2 {T) < 0, it follows 
that A 2 (t) < 0. Hence, either r = 0 or Ai(t) = 0. Notice that since Xi(t) > X 2 {t) for all t, Ai is strictly 
increasing (see Then the former case implies that X 2 (t) < 0 for all t G [0,T]. In the latter case, we 

get that A 2 (t) < 0 for all t < t. □ 

This information about the covectors allows us to solve the optimization problem based on the initial 
conditions and the final time. Recall from Proposition o that ^i(O) > 0. 

Theorem 4.8. Let M=2. Let ( 01 , 02 ) G IA 2 be an optimal control strategy and ^ be the corresponding 
trajectory for system (19l. He/ine tp = 2In (^i(0)/(2^(0))). 


(i) If ^ 2 ( 0 ) > 0, then ( 01 , 02 ) = (1,1). 
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(a) If ^ 2 ( 0 ) < 0 and T > t^, then ^2(1") = 0 and ai = 1. For instance the strategy (ai,a2) = (1,0) for all 
t S [0,io[ and (ai,a 2 ) = (1,1) for all t € is optimal. Furthermore, if there exists i S [0,T[ such 

that £, 2 (t) = 0, then £, 2 ( 1 ) = 0 for all t G \t,T]. 


(Hi) If £2(0) ^ 0 and T < t^, then there exists t* 
aft) = (1,0) for all t G [t*,T]. 


G [0,T[ such that aft) = (0,0) for all t G [0,t*[ and 


Proof. Let {ai,a 2 ) be an optimal control strategy and £ be the corresponding trajectory. 

(i) Let ^ 2 ( 0 ) > 0. According to Prop. |1.1| for all t G [0,T] it holds £i{t) > 0 and £ 2 ft) > 0. Then Ai(r) > 0 
and A 2 (T) > 0. From Prop. |4.7| it follows that Ai(t) > 0 and X 2 ft) > 0 for all t G [0,T]. According to the 
PMP (see Section 4.11, maximal control has to be used at all time, i.e. (ai,a 2 )(t) = (1,1) for all t G [0,T]. 

For cases (iij and (Hi), let ^ 2 ( 0 ) < 0. By Prop. Oit holds £i(t) > 0 for all t G [0,T]. Suppose that 
£ 2 ( 1 ") > 0. Then from Prop. [TT] we get Ai(t) > X 2 (t) > 0 for all t G [0,T], so ( 01 , 02 ) = (1, !)■ But with this 
strategy ^2 = —£ 2 , so £ 2 (t) = £2(0)e~* < 0 for all t G [0,T], which contradicts ^2(7") > 0. Hence £ 2 {T) < 0. 
(a) First assume that T > Iq. Let us show that £ 2 fr) = 0 and oi = 1. Such a strategy exists, since for 
instance the control (/3i,/32)(t) = (1,0) for t G [0,to[ and {/3i,j32)ft) = (1,1) for t G [to,T] achieves £ 2 ( 1 ) = 0 
for all t G [to,T] (where £^ denotes the trajectory corresponding to the control strategy /3) - by direct 
computation of (IT^. Suppose that £ 2 fT) < 0. Then o cannot be optimal since the control strategy /3 achieves 


the minimum of £f{T)‘^, see ( [I^ , and of £ 2 fT)'^ and therefore the minimum of V(T) = ^f(T)^ + £ 2 [T)‘^. 
Hence a must satisfy ai = 1 and £ 2 {T) = 0 in order to perform as well as /3. Obviously, all strategies that 
achieve £ 2 {T) = 0 with ai = 1 achieve the same final positions (see (iMl)) and thus have the same V(T). 
Furthermore, if there exists a. i < T such that £ 2 ft) = 0, then £ 2 ( 1 ) = 0 for all t G [i,T]: if £ 2 ( 1 ) = 0, then 

£ 2 ( 1 ) = (1 — a 2 )£it) > 0 and therefore £2 cannot become negative, once it reaches 0. On the other hand, if 
£ 2 ) 1 ) > 0, then £ 2 iT) > 0 by Prop. me 2 canno 

(Hi) Assume now that T < tg. Firstly, we show that an optimal strategy (by PMP) always achieves 
^ 2 ( 7 ") < 0. We argue by contradiction: Assume that £ 2 {T) = 0. Then Ai(T) > 0 and X 2 fT) — 0 and, 
according to Proposition 4.7 it follows that Ai(t) > A 2 (t) = 0 for all t G [0,r]. According to the PMP, 
ai = 1. Then the growth of ^2 is maximal if, and only if, 0:2 = 0 since in this case £ is maximal. But with 
this strategy ^2 cannot reach 0 before to - by direct computation of (19). Therefore £ 2 fF) < 0, so X 2 fT) < 0 


and X 2 ft) < 0 for all t G [0,r] by Prop. 4.7 Hence we are in the same situation as in the case M = 1 and 
M < 1. Two cases are possible: either Ai > 0 at all time, so the set /jj" is non-empty and full control on 
is used at all time, or there exists t* s]0,T[ such that Ai < 0 on [0,t*[, Xift*) = 0 and Ai > 0 on ]t*,T], in 
which case a = (0,0) on [0,f*[ and a = (1,0) on ]t*,T]. □ 

Remark 4.9. To compute t* G [0,T[ in the case ^i(O) > —^ 2 ( 0 ) > 0 and T < to, one can compute V(T)(A) 
depending on t* G [0,T[ similarly to the case M = 1. 


4.6 Case 1 < M < 2 

As in the case M = 2, we state the following properties concerning the covectors A. 

Proposition 4.10. Let M €]1, 2[ and Ai and X 2 be the covectors corresponding to an optimal control strategy 
for the system (19). They satisfy the following properties: 


(i) If X 2 {T) > 0, then Xift) > 0 and X 2 {t) > 0 for all t G [0,T]. 

(a) If X 2 fT) = 0, then Xift) > 0 and X 2 {t) = 0 for all t G [0,T]. 

(Hi) If X 2 {T) < 0, then X 2 ft) < 0 for all t G [0,r]. 


Proof. The proof is very similar to that of Prop |4.7[ 

(i) Let X 2 {T) > 0. Suppose that there exists r G [0,T[ such that X 2 fr) = 0 and X 2 {t) > 0 for all t g]t,T]. 
Then if Xi > X 2 > 0 on ]r,T], according to Pontryagin’s maximum principle (see Section ).l), ( 01 , 02 !^ 


(1,M— 1) on ]t,T], which gives X 2 = ^X 2 . //Ai = A 2 > 0 on ]t,T], then ai + a 2 = M (see Figure\lbV, 


fir-T) 


which also gives X 2 = ^X 2 . Hence, A 2 (t) = A 2 (T)e 2 
For (ii) and (Hi) we reason the same way as in the proof of Proposition J^.l 


> 0, which contradicts the definition ofr. 


□ 
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As in the previous sections, this allows us to solve the optimal control problem by distinguishing cases 
based on the initial conditions and the final time. The case ^ 2 ( 0 ) < 0 is illustrated in Figure]^ 

Theorem 4.11. 

Let M g] 1 , 2 [. Let a S Um be an optimal control strategy and ^ be the corresponding trajectory. 

Define to < <1 < t2 as: to = 21 n(^||[^) , h = and ta = ^H^)- 

7 /^2(0) > 0 , two subcases are to be distinguished: 

• If T < t2, then ( 01 , 02 ) = (1,M — 1) and 0 < £,2{T) < £,i{T). 

• If T > t2, Ci('T) = f2{T) and oi + 02 = M. 

In the case ^ 2 ( 0 ) < 0, four subcases appear: 

• If T < to, then f,2(t) < 0 and there exists t* S [0,T[ such that (oi, 02 )(t) = (0,0) for all t G [0,t*] and 
(ai, 02 )(t) = (1,0) for all t G]t*,T]. 

• to < T < ti, then oi = 1 and ^ 2 (T) = 0. 

• If ti < T < t2, then ( 01 , 02 ) = (1,M — 1) and 0 < ^ 2 ('T) < 

• Ift2< T, then Oi + 02 = M and ^i(r) = £,2{T). 


Remark 4.12. Notice that if = ^ 2 ( 0 ), then t 2 = 0. 


Remark 4.13. In the limit case M —> 1, the times to and ti are equal, which 
In the limit case A7 —> 2, ti and t 2 are undefined, in line with Theorem\4-.8\ 


is in line with Theorem 


4.2 



(a) T < to (b) to < T < ti (c) ti < T < t2 (d) t2 <T 

Figure 2: Control strategies in the case ^ 2 ( 0 ) < 0 (controlled agents in red, uncontrolled ones in blue) 


Proof. See appendix. 


□ 


5 Final cost with any number of agents and control bounded by 
M=1 

5.1 Theroretical Analysis 

In this section, we address the optimal control problem of minimizing V(T) with any number of agents, 
setting the upper bound M = 1 on the strength of the control, i.e. X)ili — 1- define the set of such 
controls: 


U = ^a: [0,T] ^ [0,1]^ 


N 

a measurable, s.t. for all t G [0,T] E a fit) < 1 

2 = 1 


(28) 


We remind the equations governing the evolution of and ^ for i G {1,..., A}: 

6 = + (1 - and | = -(^ afi f. (29) 

i 

N 

As before, we aim to minimize the migration functional "V = ^ over the space 14 at final time: 

i=l 
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Problem 1. Find argminV(T). 

OL&A 

Let us consider the restricted set of full-strength controls Ups C lA : 


N 

Ups = : [0;^] [0,1]^ a measurable, s.t. for all t, = l|. 


( 30 ) 


We also introduce the set of optimal controls Uopt- 

iAont = \ a GU s.t. Ya = min 
^ I peu 


(31) 


A question then arises naturally: are there optimal controls among full-strength controls? In other words, 
we study the intersection Upg FUopt- To answer this, we first look for an optimal control strategy among 
the restricted set of controls Upg, i.e. we consider the problem: 

Problem 2. Find arg min V(T). 

ch&Afs 

Introducing the partial mean = j X)i=i design the following optimal control strategy to solve 

Problem |2] 


Theorem 5.1 (Full-control strategy). 

Let T > 0. The strategy designed in Prop 


2.1 


to decrease V instantaneously is an optimal control strategy 


for Problem^ It can be explicitly described as follows: 

Define h = 0 and for I e {2, ti = In {^{l - 1)^^ + l) • 

If there exists I S {1,..., iV— 1} such that T G [ti, then any strategy satisfying: f,i(T) = fi^i(T) for every 
i € {1,..., 1}, Oi = 1 and ai = 0 for every i G {/ -f 1,..., N} is optimal. 

If T h tjY, then any strategy satisfying £,i{T) = ^{T) for all i G {1,..., N} and cti = 1 is optimal. 

For instance, ifTG [ti,tipi[, one optimal strategy would consist in defining the following piecewise constant 
control: 


Vfc <l,\/t G [tk,tk+il 


ai(t) = \ifi<k 
ai{t) — 0 if i > k. 


(32) 


Proof. Let us first show that if T > tp then the optimal control strategy for Problem must achieve 
fi{T) = fi^i{T) for all i G {1,..., 1}, reasoning by contradiction. 

Suppose that there exists k G {1,...,?} such that ^k{T) ^ Ci,i(T). Using Hyp. we can suppose that 
there exists m < I such that for every i G {1,..., m}, ^i(T) = fimiT), and for every i G {1,...,to} and 
jG{m+l,...,iV}, 0(T)<^.(T). 

Let j G {m + 1, ...,^}. The transversality condition gives: for every i G {1,...,to}, \j{T) < Xi{T). 
According to Proposition |3.1[ for all t G [0, T], for every i G {1,..., m}, Xj{t) < Xi{t). According to the PMP, 
as seen in Section]^ only the biggest covectors are controlled, and since a G ?^fSj with maximum control. 
So = 1 and aj = 0. The evolutions of and are then given by: 


fl,m = 


(33) 


Since evolution of the mean is given by ^ and we can compute f = ^(0)e 

which in turn allows us to solve: 


We get: 


\fiMt) = e-‘ (6,m(0) + ^i^e(0)(e^‘ - 1)) . 
(6,m - ^jW) = e-^ (^ei,m(0) - ^,(0) - - 1)) . 


(34) 


(35) 
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We made the hypothesis that T >ti = In ■ Hence, 


(ei,n^ - ^j){T) < e-^ 6,m(0) - ^,(0) - -(/ - l)(ei,/-i(0) - 6(0)) 


= —e ^ [m^i,m(0) - m6(0) - {I - 1)^1,/_i(0) + (/ - 1)6(0)] 


(*) 1 
^ —e 
m 


-T 


i-i 


-T 


Y1 - H6(0) 

. 2—1 2 — 1 

1-1 

- E m + 


i— 7 n-\-l 


( 36 ) 


= —e 
m 

< [-(Z - 1 - m)^i(O) + {l-l- m)^i(O)] 

= 0 , 

where inequalities (*) derive from Hypothesis § since j < I, ^j(O) > ^i(O). However, - Cj)(T) < 0 
contradicts that ^j{T) < ^i{T) for every i G {1, ...,m}. From this we conclude that if T > ti, then for every 
i G {1,..., 1}, ^i{T) = fi,i(T) for an optimal control strategy fulfilling Hypothesis]^ 

Let us now show that if T < ti+i, then for every k G {I + 1, ■■■,1V}, = 0 and ^fc(T) < 


^iAT)-UT)=e 

( 2 ) 

> e 


“ " Ci.i(O) - ^fe(O) - 


-T 


6,i(0) - Cfc(O) - 


E“.3' “ ak)is)A0)ds 
^ i=i 


N-l 1- ' 

e « '*y^(0)ds 


„-T 


6.z(0)-a(0)-^)e(0)(e' 


- 1 ) 


(37) 


( 3 ) - - 

> (6,i(0) - ^fe(O) - (^i.i(O) - ^i+i{0))) 

= e-^(6+i(0)-a(0)) 

(4) 

> 0 , 

where: 

(1) was computed using the evolutions of and A,i- tk = ~Cfe + (l~Q^fc)f and ^i i = —Ci,i + (1~ j ^i)A 

(2) was obtained from inequalities ^ji^) — 1 and ak{t) > 0 for all t, 

(3) comes from the inequality: T < ti+i = AAi + 1), 

(4) derives from Hypothesis since k>l + l. 

Hence, for every k G {I-\- ^fc(T) > ^i.;(T). Furthermore, the transversality condition (151 and 

Proposition |3.1| imply that for all t G [0,r] for every i G {1, ■■■,!}, Xk{t) < Xi{t) and the Pontryagin 
Maximum Principle as seen in Section Instates that = 0. So Cfe(T) > A,iiT)- 

We proved that if T S then for every i G {I + 1, ai = 0^ Since ^ is fully determined as 

a G f^FSi this means that for all i G {I + !,■■■, .Mj, ^i(T) is also fully determined (satisfying the equation 
= —^i+^ )■ On the other hand, we proved that for all i G {1,/}, = A,i(T) and that 

so A.i is also fully determined (satisfying the equation = —A,i + )• Hence, any strategy such that 

for all i G {!,■■■, Zj, ^i{T) = ^i,i(T) with = t and for all i G {I + = 0 is optimal for 

Problem |2] □ 

Notice that this optimal control strategy is not sparse, as control is split among more and more agents 
as time goes. However, it is not unique and one could very well act on one agent at a time until all reach 
the known final velocities. Going back to the general Problemwe prove that under certain conditions, the 
optimal control strategy uses full strength at all time, i.e. q:°p* G Ups- 
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Theorem 5.2 (Sufficient condition for full control). _ 

Define the time tf^ = In gw(o) , + ij as in Theorem ^S. 1^ 

If T > t]sf, then the optimal strategies to Problem\A belong to lAps O'lT’d for these controls ^i{T) = £,{T) 
for every i G {1, N}. 


Proof. If T > tN, then the instantaneous decrease strategy designed in Theorem 5.1 is optimal. Indeed, we 
noticed that the migration function al ca n be written as the sum of two terms (lOl: "V = ^ ~ ■C)^- 

The strategy designed in Theorem 5.1 minimizes ^(T) by using full control at all time, hence minimizing 
since ^ > 0. Furthermore, it achieves ^i(T) = f(T) for all i G {!,..., A^}, thus minimizing the second 


term 


AT s; • Hence any optimal control strategy has to use full control at all time and achieve 

£,i{T) = £,{T) for every i G {1,..., N} in order to perform as well. □ 


We finally address the general case stated in Problem]^ minimize V(T) over the set of controls U, for a 
given final time T. In the following theorem, we show the existence of an initial "Inactivation" time interval: 
the optimal strategy can require to let the system evolve freely (i.e. without control) at initial time, before 
acting on it with full strength. 

Theorem 5.3 (Inactivation Principle). 

IfT < tM, t hen one of the two holds: any control strategy either belongs tolAps ond the strategy designed 
is optimal, or there exists some 6 < T such that = Q on [ 0 , 5 ], and ^ = 1 on [ 5 , T]. 


in Theorem 


5.1 


Proof. According to Hypothesis]^ we can assume that ^i(T) > ^i{T) for every i G {1, ...,N}. Furthermore, 
^(T) > 0, so f,i{T) > 0. From the transversality condition (151 we deduce: Ai(T) > Xi{T) for every 
i G A^} and Ai(r) > 0. From Prop. |3.1| we know that for all t G [0,r], Ai(f) > Xi(t). According 

to Prop. |3.3| full control is used at time t if Ai(f) > 0 and no control is used if Ai(f) < 0. Let us study 
the evolution of Ai: Ai = ^'Yfo^jXj — A + Ai. By the Pontryagin maximum principle, we always have 
J^o^jXj > 0. Furthermore, Ai — A > 0. So Ai(t) > 0 for all t e [0,r]. We show that Ai = 0 at most at 
one point. Indeed, suppose that Ai(r) = 0 for some r G [0,r] and that Xi(t) = 0. Then Ai(t) = —A(t) 
so A(t) = Ai( t) = 0, and since the A^’s are ordered, Xfir) = A(r) for every i G {!,..., A^}. According 
to Proposition |3.l[ Xi(t) = X(t) for all time t and every i. Since Ai(T) > 0, there exists a time interval 
[t*,T] such that Ai(f) > 0 for all t G [t*,T]. On this interval, Ai = jfXiJ2jOtj = jfXi, which gives: 
Ai(T) = Ai(T*)ew(^“'^ ). This contradicts the existence of a time r at which Ai(r) = 0. In conclusion, if 
Ai(t) = 0, then Ai(t) > 0 so Ai = 0 at most at one point. 

Hence, there is a dichotomy of cases: 

Either Ai(f) > 0 for all time, so I{t) 0 for all t, which implies that g ^pg according to Prop. |3.3[ In 
this case, argmax^g^y V = argmax^g^^pg V and the control strategy designed in Theorem 5.1 for Problem]^ 
is optimal also for Problem 

Or there exists <5 G [0,T] such that Ai(f) < 0 on [0,(5[ and Ai(t) > 0 on [5, T], which implies that a{t) = 
0 on [0,(5] and ’Yfafif) = 1 on ]5, Tj. Practically, an optimal control strategy would consist in letting the 
system evolve without control on [0, i5[. Then the full-control strategy from Theorem 5.1 can be applied on 
[(5,r] with the new initial positions ^(i5). □ 

Remark 5.4. Although this result may seem counter-intuitive, in certain cases it makes sense to let the 
system evolve freely, at least initially. I nde ed, without control the system naturally regroups in order to reach 
consensus, minimizing (lOf keeping ^ constant. Actual examples of such cases are shown 

in the next section. 


Remark 5.5. Note that a constraint M < 1 would not change the nature of the results. It would only mean 
acting with less strength on the controlled agents, therefore changing the values of the times U defined in 
Theorem\5. 1[ but the optimal control strategy would be unchanged. With a constraint M > 1, we can expect 


results similar to those of Section |7} with two kinds of Inactivation periods, consisting either in letting the 


system evolve freely, or in controlling it with a non-maximal total strength 0 < ai < M (see Theorem f.8 
(ii) and (Hi)). 


16 


















5.2 Practical Approach 

We proved in the previous section that the optimal strategy can either be to act with full control as in 
Theorem |5.1[ or to let the system evolve without control on some time interval [0,(5], before acting with full 
control on ](5, Tj. In this section, we explore the practicality of Inactivation strategies. 

First, we run numerical simulations to find cases in which the optimal strategy involves Inactivation. The 
migration functional Ws can be computed explicitly as a function of 6. We then look for the value of S that 
minimizes Ys{T). Let us denote by the solution to system (291 when no control is applied on [0,5] and 
full control is used on ]5,T]. Equation (291 gives: 


= 0 


on [0,5], 


(38) 


which all ows us to solve: ^f(5) = e ^ (0) + ^^(0)(e‘^ — 1)). We then apply the strategy designed in 

Theorem 5.1 with the new initial conditions ^'^(5) and the new final time T — 6. Define the times = 0 and 

for I G {2,...,iV}, tf = j^ln ( (Z- + 1). Find I G {1,...,iV - 1}, such that T - 5 G 


[tf, if+i[- Then any strategy satisfying ^f{T) = i{T) for every i G {1,..., 1}, Yli=i Q^i(0 = 1 for all t G [5, T], 
and Ui = 0 for every i £ {I + 1 ,..., N} is optimal. From equation (p^ we get: 


el, = -el, + ^e'^ 

d' = -ef+e'' for zG W} 


on [5,r], 


(39) 


from which we can solve: 

= el,(r) = (eX;(5) + , g _ 

N-1 , 


(T) = (^^(5) + llie'10)(e^(^-^) - 1)) for all t£{l + l, 


(40) 


N 


We can now compute Y^(T) = ^ and numerically look for min V‘^(T) (see Figure 


Z=1 


5g[0,T] 


3). 



Figure 3: V^{T) with respect to Inactivation time 5. Here the optimal Inactivation time is 5 = 1.94. 

Series of simulations were run to look for cases in which 5 > 0. Table [l] lists the percentage of such 
cases found over 1000 simulations, for different values of the number of agents and of the final time. Initial 
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projected variables ■^^(0) were chosen randomly in the interval [—1,1] and such that the mean ^ is strictly 
positive. As expected (and proven in Theorem |5.2[ ), for larger values of T, it is always optimal to act with 
full control at all time (in other words i5 = 0). One also notices that as the number of agents increases, 
"Inactivation" cases become less and less frequent. 


Number of agents 

5 

10 

20 

50 

T=3 

1.6 % 

0.9 % 

0 

0 

T=4 

1.8 % 

0.7 % 

0.3 % 

0 

T=5 

1.0 % 

0.2 % 

0.2 % 

0 

T=6 

0.2 % 

0.1 % 

0 

0.1 % 

T=7 

0 

0 

0 

0 


Table 1: Percentage of cases in which S > 0 out of 1000 simulations. ^i(O) chosen randomly in [—1,1]. 

Table 2 shows the average of the relative difference , where was obtained by using optimal 

control ana Vfc by using full control at all time (as designed in Theorem |5.1[ ). The gain in performance when 
using the optimal strategy is minor (significantly less than 1% in most cases), and decreases as the number 
of agents increases. 


Number of agents 

5 

10 

20 

50 

T=3 

0.073% 

0 .001% 

- 

- 

T=4 

0.27% 

0.018% 

0 .001% 

- 

T=5 

0.91% 

0.056% 

0.0069% 

- 

T=6 

1.53% 

0 .2% 

- 

0.00003 % 


Table 2: Average relative improvement of w.r.t. Vfc 


The occurrence of Inactivation c ases can be explained by looking at the two terms in the migration 
functional V = ~ 0^ (lOl. When is small, the control strategy should concentrate on 

minimizing the second term A ^(^j — ?)^, which does not necessarily require full control since the system 
naturally evolves to minimize this term. To confirm this reasoning, we look at the ratio R := ~ 

in one set of simulations {N = 5, T = 3) and find that the Inactivation cases correspond exactly to 
the largest values of R. Furthermore, the larger the ratio, the longer the Inactivation interval (see Figure]^. 



Figure 4: Ratio R := a- function of the length of the Inactivation interval 6, for 20 

simulations involving Inactivation with TV = 5 and T = 3. The Inactivation 6 increases as tends to zero. 
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Hence, Z^opt HZ^fs = 0 occurs in very few cases, namely those in which ^ jj ~ ■ Furthermore, 

when Inactivation exists, the gain in performance compared to the full control strategy is very minor. For 
reasons of computational speed and complexity, it is very reasonable to neglect those cases and to apply the 
full control strategy at all time. 

Figure]^ shows the evolution of the projected velocities i S {1,..., 10} with respect to time, in a case 
where the optimal strategy requires full control at all time, with T > tiQ. The control function is the one 
designed in Theorem |5.1| and acts first on ^i, then on and ^ 2 , and so on until all have reached consensus 
(in terms of the projected velocities ^i), at which point it acts with equal strength on all agents to drive ^ 
down to 0. 



t 


Figure 5: Evolution of the projected velocities with the full strength optimal control for a system of 10 
agents. In this example ^(0) = 0.25 so full control at all time is needed to drive ^ to the desired velocity 
V = Q (i.e. 5 = 0). At final time T = 4.5 the system has reached consensus, but not yet at the desired 
velocity. 


6 Optimal control for integral cost 


In this section we focus on minimizing the integral of the migration functional, with the constraint on the 
controls M = 1. As done in Section]^ we define two problems (where U (2% ] and Uys (301 are defined as 
before). 

Problem 3. Find argmin [^Y(t)dt. 

Problem 4. Find min J^Y{t)dt. 

Ol&Afs 


6.1 Pontryagin’s Maximum Principle 


We first prove general results, with the aim of solving Problem In order to use Pontryagin’s maximum 
principle, we introduce the new Hamiltonian H — (A, /) + A°V and the equations governing the covectors’ 
evolution Ai = Considering normal trajectories, we set A° = 1 and obtain: 


N 


N 


N 


Ai = Ai — ^ ~ ^j)^j ~ 


(41) 
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Since the final condition is not fixed, we have the following transversality condition for the covectors: 

A(T) = 0. (42) 

As in the minimization of the migration functional at final time (Section , we define 1\ and (see Q). 
Then minimizing H — + H (where H contains only uncontrolled terms) requires the following : 

if k ^ I\, Ofc = 0; furthermore, if ^ 0, then 

As in Section]^ we make HypothesisGiven the initial order on the agents’ projected velocities ^i, we 
prove the following: 

Lemma 6.1. There exists an optimal control strategy satisfying: 


VtG [0,T], iV}, i < j ^ m > ^,it). 


(43) 


Proof. The proof is very similar to that of Lemma |3.2[ Consider an optimal con trol strategy a G U. 

Define r = sup{t \ 3P G U s.t. y/ 3 (s)ds = fj' Va(s)ds and satisfies (43) on [0,f]}. Let us prove by 
contradiction that t = T. Suppose that t < T. Then there exist i,j G {1,..., N} with i < j such that 
^f(r) = fjir) and ^j{t) > {t) on ]t,t + i5] for some 5 > 0. Design a control strategy (3 such that on 

[t,T], Pi = Pj, Pj = P^ and for every k G {1, \ {i,j}, Pk = Pk- Then for all t G [t,T], (t) = ^|(t), 

and f,j{t) = £,i{t). So for all t G [r, r + i5], (t) > ^j{t) and for all t G [0,T], V^(t) = V^(t). Proceeding 

likewise for every pair of indices (m, n) satisfying m < n and fl^ft) > ^^{t) on ]t, t + <5] we are able to design a 
control strategy P satisfying (43) on [0,t + i 5] and 'Vp{t)dt = 'Va{t)dt, which contradicts the definition 
of T. In conclusion, t = T, i.eTfor all t G [0,T], for every i,j G {1, i < j => fi{t) > ^j{t). □ 

Hence, as in Section|^ we can assume Hypothesis|^ for all t G [0,T], if i < j, then ^i{t) > £,j(t). By the 
following proposition, we shall prove that the same order is observed among the covectors A^. 


Proposition 6.2. 


Vt G [0,T], i < j ^ X^{t) > Xj{t). 


(44) 


Proof. Let us reason by contradiction. Suppose that there exists r G [0,T] such that for some i<j, 
(Ai — Aj)(r) < 0. From the evolution of the covectors ( [H] ) we derive for all t > t: {Xi — Xj){t) = 

((^i - - 2 Jr - ^j){s)dsy Since (Ai-Aj)(r) < 0 and for all s G [0,T], i^i-Q{s) >0, 


we deduce that for all t G [t,T], {Xi — Xj){t) < 0, which contradicts the final condition (42). 


□ 


Proposition 6.3. Let r G [0,T] and i,j G {!,...,A^}, such that {Xi — Xj){T) = 0. Then for all t > t, 
{Xi - Xj){t) = 0 and {^i - ^j){t) = 0. 

Proof. Let r G [0,r] and G {1, ...,N}, such that (Ai — Xj){T) = 0. Then for all t > t, 


{Xi — Xj){t) — —2e* 




ii^-Qis)ds. 


(45) 


Suppose for instance that i < j. According to Proposition |6.2[ for all t G [0,T], (A^ — Xj){t) > 0. Since we 
made Hypothesis]^ the right-hand side of equation (45) is nonpositive. This is only possible if both sides 
are equally zero. Hence, for all t > r, (A^ — Xj){t) = 0 and {^i — ^j){t) =0. □ 

The following proposition states that if at a certain point in time, two agents have the same projected 
velocities, then these should stay identical until final time. 

Proposition 6.4. Suppose that there exists r G [0, T] and i,j G {1, ..., N} such that = f,j{T). Then 

for all t>T, ^i{t) = fj{t). (46) 

As a consequence, for almost all t > t, ai{t) = Oij{t). 
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Proof. Let r G [0,T] and i,j G {1, ...,7V}. Define f = sup{f > r | for all t G [t, f]}. Notice from 

(291 that this implies that ai{t) = aj{t) for almost every t G [t, f]. Let us prove that f = T. 

Suppose that f < T. Then there exists <5 > 0 such that for all t G]f, f + 5], £,i{t) Define (3 such that 

/3 = a on [0, f] and 

\Pi= Pj = \{a^ + aj) 

\ Pk = otk ior k ^ i, j 


on r 


,T], 


and denote by the corresponding trajectory. Notice that '^f^o-k = YhkPk^ so according to (29), f*®. 

This implies that fk = Pu ^ *>.?■ Moreover, Ui + aj = f3i + j3j so for all t G [f,T], {fi + £,j){t) = 

(^f +fj){t). Furthermore, and satisfy the same differential equation on [t,T] and (r) = so 

for all t G [f, r], (t) = (t) = Define ¥„ and as the cost functions associated respectively 

with the controls a and /3. Then Yp = Ya on [0,f]. On ]t,T], 

Y^-Y^ = J2{fkr - = (^0" + (4)' - (ef)" - 


= (4f+ (4)^-2(-(4 + 4))^ = (4-4)^ 


Hence, for all t G]'f,f + 5], Va(t) > Yp{t), and for all t G [f + S,T], Ydt) > V/ 3 (t). We get /g^ < f^Ya, 


Jo _ \P ^ Jo 

which contradicts that a is an optimal control. In conclusion, t = T, which proves the proposition. 


□ 


6.2 Optimal full-strength control 

We design an optimal control strategy for Problem]^ 

Theorem 6.5. Let J{t) = {i G {!,...,TV} | = maxj^j(t)}. The following eontrol a is optimal for 

Problem^ 

fVz G Jft), apt) = 

I Vi ^ J(f), apt) = 0 . 


(47) 


Proof. According to Pontryagin’s maximum principle and the expression of the Hamiltonian (411, the optimal 
control strategy solving Problem requires to set 1 = 0 for k p I{t), where 

I{f) := {i I Xpt) = maxj Xj{t)}. Furthermore, according to Proposition 6.3 if Xi{t) = Xj{t), then f^pt) = ^j{t) 


for all t > t, and according to Proposition 6.4 ai{t) = aj{t) for almost every t > t. Hence, the optimal 


strategy in fact requires to set, for almost every t G [0,r], 

Jvi G I{t), apt) = 
[Vi p I{t), apt) = 0, 


(48) 


where | • | denotes the cardinality of a set. Let us prove that I{t) = J{t) for almost every t. Assume that 
i £ I{t) and (48) holds true. According to Proposition |6.2| the covectors are ordered, so Ai(t) = • • • = Xi{t). 
From Proposition 6.3 and Hypothesis]^ this implies ^i{t) = ■ ■ ■ = $,i{t), so i G J{t). Conversely, assume that 
i G J{t). Then from Hypothesis]^ 4(4 = • • • = 4(4- According to Proposition 6.4 ai{t) = ■ ■ ■ = apt). 
Since a{t) verifies (48), we deduce that i G I{t). Therefore, I{t) = J{t) for almost every t G [0,T] and the 
optimal strategies (48) and (@ are equivalent. 

□ 

Notice that the control strategy in the case of integral cost minimization with full control (Problem ]^ is 
equivalent to the Instantaneous decrease strategy of Prop. 2.1 (taking TW = 1). It is more restrictive than 
the optimal strategy minimizing the final value of the migration functional with full control (Problem ]^ 
seen in Section ^ Indeed, this control strategy cannot be sparse. In order to minimize Y{t)dt, one has 
to split the control among more and more agents. However, any optimal control solving Problem ]^ is also 
optimal for Problem]^ 
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6.3 Optimal control in the general case 

After designing the optimal strategy for Problem]^ we show that Problemsandare actually equivalent, 
i.e. that the optimal control solving Problem belongs to Ups- 


Theorem 6.6. The optimal control strategy for Problem^requires using full-strength control, i.e. a G Upg. 


Proof. According to the Pontryagin Maximum Principle (see Section 6.1), if Ai(t) > 0 for all t, then full 
control must be used at all time. Combining the final condition ( |4^ and the evolution ( |4T| ), we get Ai(r) = 0 
and Ai(T) = —2fi{T) < 0. Hence there exists an interval ]t,T[ on which Ai > 0. Let r = inf{f G 
[0,T] s.t. Ai(s) > 0 for all s G]t,T[}. Suppose that t > 0. Then Ai(t) = 0. Furthermore, Ai(t) = 
(Ai — A)(t) — 2^i(t). We compute: Ai — A = Ai — A — 2(^i — f). Denoting A = Ai — A, we get the 
following evolution backwards in time: A = —A + 2(^i —^). Recall that backwards in time, we also have: 
Cl = Cl - (1 - ai)C- If A = ^ 1 , then A = - 2f = ^i + (1 - ai)C - 2C = 6 - (1 + ai)C < Ci- Since 
A(T) = 0 < Ci(^)) this implies that A{t) < fi{t) for all t G [t,T]. Hence, Ai(r) = A(t) — 2^i(t) < 0, which 
contradicts the definition of r. We conclude that Ai(t) > 0 for all t g] 0, T[, and that ciz = 1- □ 


Hence, the control strategy designed in Theorem|6.5|is an optimal strategy for the minimization of integral 


cost (Prob 
Figure 


)_[§. 

I^h 


Unlike in the minimization of the final cost (Prob. [H, there is no initial Inactivation period, 
illustrates the control strategy designed in Theorem|6.^ In this example, 5 agents are to be con¬ 


trolled optimally to reach consensus at the target velocity V = (1, 0). Initially (Figure [6a|, only one agent is 
controlled, the agent with the biggest projected velocity over v—V. The set J{t) = argmaxjg^i^ 
contains more and more agents as time goes (6b 6c) and eventually, control is split evenly among all agents 
(see Figure 6d). 



Figure 6: Control of 5 agents to reach the target velocity V = (1,0). Agents are represented in the velocity 
space, controlled ones in red, uncontrolled ones in blue, and the mean velocity in black. Initial positions are 
marked by stars. 
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Appendix 

Proof. (Theorem |4.11[ ) First, let Ci(0) > ^ 2 ( 0 ) > 0. According to Prop. |1.1| ^i(t) > 0 and > 0 for 


all t G [0,r]. The transversality condition gives Ai(r) > 0 and X 2 {T) > 0, and according to Prop. 4.10 


Ai(t) > 0 and X 2 {t) > 0 for all t <T. According to Pontryagin’s maximum principle (see Section [4~l| , the 
global strategy requires setting oi -|- 0:2 = M. In this case, f{t) = ^(0)exp(—does not depend on the 
choice of ai and 0 : 2 . Minimizing V (24) therefore amounts to minimizing (^1 — ^ 2 )^- 
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(i) If T > ^ 2 ) we will show that in addition to satisfying ai + a 2 = M, the optimal control a must achieve 

^i(r) = ^ 2 {T). Such a control strategy exists, since for instance (as one can see by direct computation 
of ( [l^ ) the control (/3i,/32)(t) = (1,M — 1) for all t G [ 0 ,f 2 [ and (/3i,/32)(t) = (M/2,M/2) for all 
t G [t 2 ,T] achieves ^f(t) = ■C 2 (^) ^or all t G [t 2 ,T], where denotes the corresponding trajectory. 
Notice that 13 minimizes f(T) by using the full strength M of the control at all time (see (|2^), and 
minimizes (^i —^ 2 )‘^(T), so it minimizes V(T) (see Hence, in order to be optimal, a must satisfy 

^i(r) = ^ 2 ( 7 ’) as well as oi + 02 = 

(ii) If T < t 2 , we will show that (ai,a 2 ) = (1?-^ ~ 1) and that and ^2 cannot be brought together (i.e. 
5i(r) > ^ 2 ( 7 ’))- Indeed, knowing that 01+02 = one can use (201 to compute: (^1 — ^ 2 )(i) = 

e“‘ ^(^1 - C2)(0) - fo(ai - a 2 )(s)f(s)e'*ds^. Since ^is fully determined, tmi„ := mmaeUM,ai+a 2 =M{t G 
[0,r] s.t. (^1 —^ 2 ){t) = 0} is achieved by maximizing (oi — 02 ), which gives: ( 01 , 02 ) = (1,M— 1). As 
seen previously, by direct computation of (19), tmin = ^2 as defined above. Hence, if T < ^ 2 , necessarily 


^i(r) > ^ 2 {T). Then Ai(r) > A 2 (T) and according to Prop. 4.10 and to Prop. |3.1| Ai(t) > A 2 (t) > 0 
for all t. According to the PMP (see 4.11, the optimal strategy is (oi, 02 ) = (1, M — 1). 

Now let ^i(O) > 0, ^ 2 ( 0 ) < 0 and ^(0) > 0. We then distinguish four subcases. 

Firstly, let us prove that if ^ 2 {T) > 0, then necessarily T > ti. Indeed, if 0 < C 2 (T) "£ ^i(T), then 0 < 
A 2 (r) < Ai( T), and according to Proposition 4.10[ 0 < A 2 (t) < Ai(t) for all t G [0, T], According to the PMP 
(see Section [ 4 ^ , ai + a 2 = M. Hence f(t) = ^(0)e“*^*'^^, and ^ 2 (f) = e“*(^2(0) + C(0) /o(l ~ Q! 2 )e^T^®ds). 
The minimum time tmin needed to achieve ^ 2 (^min) > 0 is achieved for ( 01 , 0 : 2 ) = (1,M — 1), which, after 
computation, gives tmin = ti as defined above. Hence, if ^ 2 {T) > 0, then T > ti. 

(iii) Let T > ^ 2 - Let us prove that 01 + 02 = M and ^i(T) = ^ 2 {T). Such a control strategy exists. 

Indeed, take for example (/3i,/32)(t) = (1,M— 1) on [ 0 ,^ 2 ] and (/3i,/32)(t) = (M/2,M/2) on ]t 2 ,T]. 
Then, by direct computation of (t) = ^2 (^) all t G [t 2 ,T] (where denotes the trajectory 

corresponding to the control /3). Furthermore, j3 is optimal since it minimizes by using full control 
at all time and achieves (^f — = 0 (see @). In order to perform optimally, the control o 

must also satisfy oi + 02 = M and ^i(T) = ^ 2 (T). 

(iv) Let T < to. Since to < ti, then as proved above, ^ 2 (T) < 0. Suppose that ^ 2 (T) = 0. Then 

Ai(T) > A 2 (T) = 0 and according to Proposition S Ai(t) > A 2 (<) = 0 for all time t. Hence, 

«! = 1 (see Section 4.11. Then minQ^lt G [0,T] s.t. ^ 2 {t) = 0} = to as defined above (obtained for 

a 2 = 0). This contradicts the condition on T. Hence, if T < to, then ^ 2 {T) < 0 and according to 

Proposition |4.10| and Section |4.1[ A 2 < 0 so 02 = 0. However, there is no information on Ai other 
than Ai = q:i/2Ai + A — Ai >0 and Ai(t) = 0 implies Ai(t) > 0. Hence, as in the previous sections, 
there exists t* G [0,T[ such that Ai < 0 on [0,t*[, Ai(t*) = 0 and Ai > 0 on ]t*,T]. This implies that 
( 01 , 0 : 2 ) = (0,0) on [0,t*[ and ( 01 , 02 ) = (1,0) on [t*,T[. 

(v) Let to < T < ti. We shall prove that ^ 2 (T) = 0 and that oi = 1. As seen previously, if T < ti, then 
f 2 (T) < 0. Suppose that ^ 2 {T) < 0. Then Ai(T) > 0 and A 2 (T) < 0 which according to Proposition 


4.10 gives X 2 {t) < 0 for all t, and according to the PMP (see Section 4.1), 02 = 0. Then ^ 2 ( 1 ) = 
e“‘(C2(0) + f(0) Jo -^0 Thus Uup ■= sup^^jr G [0,r] s.t. ^ 2 ( 1 ) < 0 for all t G [0,r[} 

is obtained for oi = 1 and by direct computation, tgup = to- Since T > to, there exists t < T such 
that ^ 2 {' t ) = 0. However, by Proposition [Hi once ^2 = 0 it cannot become negative again, which 
contradicts ^{T) < 0. Therefore, ^ 2 (T) = 0, and according to Proposition 4.10 and the PMP (Section 


4.1), Ai(f) > 0 for all t G [0,T] so ai = 1. Furthermore, if ^ 2 {t) = 0, then ^ 2 (t) = (1 — C( 2 {t))^{t) > 0 
since a 2 = M — ai = M — 1 < 1. According to Proposition 0 once ^2 becomes positive it cannot 
become zero again. Hence we must have ^ 2 {t) < 0 for all f < T and ^ 2 {T) = 0. 

(vi) Let ti < T < t 2 . As in the previous case, since T > to, one must have: ^ 2 {T) > 0. Suppose 
that ^ 2 (T) = 0. Then according to Proposition 4.10 and the PMP, ai = 1 and ^2(0 = e“‘(52(0) + 
C(0) /o^(l ~ Q: 2 )(s)e“lo Then the minimum of ^ 2 {T) is obtained for 02 = M — 1, so 

6(T) > e-^(6(0) + e(0) / (2 - M)e-5^*eMs) > e-^(?2(0) + ?(0)(e^‘^ - 1)) > 0 

Jo 

by definition of ti. This contradicts ^ 2 (T) = 0, so necessarily ^ 2 (T) > 0. Then Ai(t) > 0 and \ 2 {t) > 0 
for all t, which implies that oi + 02 = M. In this case we prove as in case (ii) that ^i(T) > (, 2 {T), 
which implies (oi, 0 : 2 ) = (1, M — 1). □ 
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